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DETAILED ACTION 

In view of the Appeal Brief filed on 02/1 0/201 1 , PROSECUTION IS HEREBY 
REOPENED. A new ground of rejection is set forth below. New references are used to 
disclose multiple phases registration and automatic registration. 

To avoid abandonment of the application, appellant must exercise one of the 
following two options: 

(1 ) file a reply under 37 CFR 1.111 (if this Office action is non-final) or a reply 
under 37 CFR 1 .1 13 (if this Office action is final); or, 

(2) initiate a new appeal by filing a notice of appeal under 37 CFR 41 .31 followed 
by an appeal brief under 37 CFR 41 .37. The previously paid notice of appeal fee and 
appeal brief fee can be applied to the new appeal. If, however, the appeal fees set forth 
in 37 CFR 41 .20 have been increased since they were previously paid, then appellant 
must pay the difference between the increased fees and the amount previously paid. 

A Supervisory Patent Examiner (SPE) has approved of reopening prosecution by 
signing below: 

/Tse Chen/ 

Supervisory Patent Examiner, Art Unit 3777. 
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1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1 -3, 5, 8-9, 1 2, 1 4 and 1 9-24 are rejected under 35 U.S.C. 1 03(a) as 
being unpatentable over Packer et al. (US 6,556,695), in view of Rose (US 
2002/01 76608), further in view of Hemler et al. (A System for Multi modality Image 
Fusion (provided as prior art in the IDS)), Maurincomme et al. (US 2001/0036303) and 
Webler (US 2007/0055142). 

3. Addressing claim 1 2, Packer discloses a device comprising: at least one input 
interface for electroanatomical mapping data and 3D image data (see Fig. 1 , col. 2, 
lines 1 4-60, col. 3, lines 51 -67, Packer discloses a device that perform an imaging 
method therefore the device must have at least one input interface for electroanatomical 
mapping data and 3D image data); a segmentation module that is capable of 
segmenting the 3D image data in order to extract a 3D surface image of objects 
contained within a volume record by way of the 3D image data (see Fig. 2A, col. 6, lines 
14-45 and col. 7, lines 7-23); a registration module connected to the segmentation 
module configured to correlate with the correct position and dimension of the 
electroanatomical mapping data and the 3D image data representing the 3D surface 
image, by matching of the 3D surface image from the 3D image data to a 3D surface 
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image from the mapping data in at least one stage of the registration (see Fig. 1 , Fig. 8, 
col. 2, lines 14-60 and col. 9, line 21 -col. 10, line 36) and a visualization module 
connected to the registration module superimpose the mapping data and at least the 3D 
image data representing the 3D surface images on one another in the correct position 
with the correct dimension and provide these for visualization via a display device (see 
Fig. 1, Fig. 8, col. 2, lines 14-60, col. 9, line 21 -col. 10, line 36 and col. 12, lines 28-61). 
However, Packer does not explicitly disclose surface profile, automatically register 
(which is automatically matching points, positions and dimensions between two 
images), the electroanatomical/anatomical map is 3D and surface matching. Rose 
explicitly discloses surface profile provide images of the surface with fine detail (see 
claim 9 and [0005-0007]). Hemler explicitly disclose surface matching (see page 335, 
last paragraph). Maurincomme explicitly discloses automatic registration of 3D images 
(see abstract, claim 1 , [0009] and [0048]). Webler explicitly disclose 
electroanatomical/anatomical map is 3D (see [0014] and [0147]). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify Packet to 
include surface profile, surface matching, 3D anatomical map and automatic registration 
as taught by Rose, Hemler, Maurincomme and Webler because the surface profile, 
surface matching, automatic registration and 3D anatomical map provide extensive 
detail about the surface, improve image quality, accuracy and efficiency of the device. 

Further it would have been obvious to one having ordinary skill in the art at the 
time of the invention was made to automatically register, since it has been held that 
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broadly providing a mechanical or automatic means to replace manual activity which 
has accomplished the same result involves only routine skill in the art. In re Venner, 120 
USPQ 192. 

4. Addressing claim 14, Packer discloses visualization module that is capable of 
real time visualization of a part of a catheter that is used within a representation of the 
3D image data that forms at least the 3D surface images (see col. 2, line 1 4-60 and col. 
13, lines 1-23). Rose discloses surface profile (see claim 9 and [0005-0007]). 

5. Addressing claim 1 , Packer discloses a method for visually supporting an 
electrophysiology catheter application in the heart, comprising: visualizing 
electroanatomical mapping data, provided during the performance of the catheter 
application, of an area of the heart to be treated (see Fig. 1 , col. 2, lines 14-60, col. 1 1 , 
lines 33-48 and col. 1 2, lines 28-61 ); recording 3D image data of the area to be treated 
with a method of tomographical 3D imaging before the catheter application is carried out 
(see col. 2, lines 25-37); extracting a 3D surface images of objects in the area to be 
treated from the 3D image data by segmentation (see col. 5, line 63-col.6, line 48); 

the visualized electroanatomical mapping data and 3D image data representing at least 
the 3D surface image being registered, with correct position and dimension, by 
correlating the electroanatomical mapping data and 3D image data representing the 3D 
surface image by surface matching, in at least one stage of registration, the 3D surface 
image from the 3D image data to a 3D surface image from the mapping data (see Fig. 
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1, Fig. 8, col. 2, lines 14-60 and col. 9, line 21-col.10, line 36 and col. 12, lines 28-61). 
However, Packer does not explicitly disclose surface profile, automatically register 
(which is automatically matching points, positions and dimensions between two 
images), the electroanatomical/anatomical map is 3D and surface matching. Rose 
explicitly discloses surface profile provide images of the surface with fine detail (see 
claim 9 and [0005-0007]). Hemler explicitly disclose surface matching (see page 335, 
last paragraph). Maurincomme explicitly discloses automatic registration of 3D images 
(see abstract, claim 1 , [0009] and [0048]). Webler explicitly disclose 
electroanatomical/anatomical map is 3D (see [0014] and [0147]). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify Packet to 
include surface profile, surface matching, 3D anatomical map and automatic registration 
as taught by Rose, Hemler, Maurincomme and Webler because the surface profile, 
surface matching, automatic registration and 3D anatomical map provide extensive 
detail about the surface, improve image quality, accuracy and efficiency of the device. 

Further it would have been obvious to one having ordinary skill in the art at the 
time of the invention was made to automatically register, since it has been held that 
broadly providing a mechanical or automatic means to replace manual activity which 
has accomplished the same result involves only routine skill in the art. In re Venner, 120 
USPQ 192. 
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6. Addressing claims 1 9 and 22, a method and device for visually supporting an 
electrophysiology catheter application in the heart, comprising: recording 3D image data 
of an area of the heart to be treated with a method of tomographical 3D imaging, before 
electroanatomical mapping data is provided during the performance of the catheter 
application (see col. 2, lines 25-37); extracting a 3D surface images of objects in the 
area to be treated from the 3D image data by segmentation (see col. 5, line 63-col.6, 
line 48); registering, with correct position and dimension, by correlating the 
electroanatomical mapping data and 3D image data representing the 3D surface image 
by matching, in at least one stage of registration, the 3D surface image from the 3D 
image data to a 3D surface image from the mapping data (see Fig. 1 , Fig. 8, col. 2, lines 
14-60 and col. 9, line 21 -col. 10, line 36); and displaying mapping data and the 3D image 
data representing the 3D surface image superimposed on one another in correct 
dimension and position (see Fig. 1, Fig. 8, col. 2, lines 14-60 and col. 9, line 21 -col. 10, 
line 36). However, Packer does not explicitly disclose surface profile, automatically 
register (which is automatically matching points, positions and dimensions between two 
images), the electroanatomical/anatomical map is 3D and surface matching. Rose 
explicitly discloses surface profile provide images of the surface with fine detail (see 
claim 9 and [0005-0007]). Hemler explicitly disclose surface matching (see page 335, 
last paragraph). Maurincomme explicitly discloses automatic registration of 3D images 
(see abstract, claim 1 , [0009] and [0048]). Webler explicitly disclose 
electroanatomical/anatomical map is 3D (see [0014] and [0147]). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify Packet to 
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include surface profile, surface matching, 3D anatomical map and automatic registration 
as taught by Rose, Hemler, Maurincomme and Webler because the surface profile, 
surface matching, automatic registration and 3D anatomical map provide extensive 
detail about the surface, improve image quality, accuracy and efficiency of the device. 

Further it would have been obvious to one having ordinary skill in the art at the 
time of the invention was made to automatically register, since it has been held that 
broadly providing a mechanical or automatic means to replace manual activity which 
has accomplished the same result involves only routine skill in the art. In re Venner, 120 
USPQ 192. 

7. Addressing claims 2-3, 5, 8-9, 20-21 and 23-24 wherein the 3D image data of the 
area to be treated are recorded with a method of at least one of X-ray computer 
tomography and magnetic resonance tomography (see col. 1 , lines 15-35 and col. 3, 
lines 51 -67); wherein the 3D image data of the area to be treated are recorded by use of 
a 3D ultrasound (see col. 1 , lines 1 5-35 and col. 3, lines 51 -67); the 3D image data are 
visualized via a volume rendering technique (see col. 6, line 1-13); wherein a 
registration is effected between a catheter used during the catheter application and the 
3D image data and at least a part of the catheter is visualized in real time in the 
representation of the 3D image data representing at least the 3D surface images (see 
col. 2, lines 53-60, col. 3, lines 25-38 and Figs. 3-7); visualize catheter without 
superimposition of the mapping data from time to time (see col. 2, lines 53-60). 
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8. Claims 4, 1 3, 1 8 and 25-26 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Packer et al. (US 6,556,695), in view of Rose (US 2002/0176608), 
further in view of Hemler et al. (A System for Multimodality Image Fusion (provided as 
prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Williams et al. (DE 19953308-A1 (provided as prior art in the IDS)). 

9. Addressing claim 4, Packer does not disclose registering with the correct position 
and dimension by automatically correlate using distinct anatomical points and artificial 
marker. Hemler discloses register by correlate the correct position and the correct 
dimension using distinct anatomical points as an effective way to ensure the images on 
display are in correct position and dimension (see page 337, line 7- page 338, line 32). 
Williams discloses correlate the correct position and the correct dimension using 
artificial marker as an effective way to ensure the images on display are in correct 
position and dimension (see abstract). Maurincomme discloses multiple stages of 
registration (see [0054] and Fig. 2). It would have been obvious to one of ordinary skill 
in the art at the time of the invention to modify Packer's system to correlate the correct 
position and the correct dimension using distinct anatomical points and artificial marker 
taught by Hemler and Williams because using multiple stages, distinct anatomical points 
and artificial marker are effective way to ensure the images display are in correct 
position, dimension and improve precision. 
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1 0. Addressing claims 1 3 and 25-26, Packer does not disclose correlate the correct 
position and the correct dimension using distinct anatomical points and artificial marker. 
Hemler discloses correlate the correct position and the correct dimension using distinct 
anatomical points as an effective way to ensure the images on display are in correct 
position and dimension (see page 337, line 7- page 338, line 32). Williams discloses 
correlate the correct position and the correct dimension using artificial marker as an 
effective way to ensure the images on display are in correct position and dimension 
(see abstract). Maurincomme discloses multiple stages of registration (see [0054] and 
Fig. 2). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Packer's system to correlate the correct position and the correct 
dimension using distinct anatomical points and artificial marker taught by Hemler and 
Williams because using multiple stages, distinct anatomical points and artificial marker 
are effective way to ensure the images display are in correct position, dimension and 
improve precision. 

1 1 . Addressing claim 1 8, Packer discloses visualization module is constructed for 
visualizing a part of a catheter used within a representation of the 3D image data, 
forming at least the 3D surface image, in real time (see col. 2, line 14-60). 

1 2. Claims 1 0-1 1 and 1 5-17 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Packer et al. (US 6,556,695), in view of Rose (US 2002/0176608), 
further in view of Hemler et al. (A System for Multimodality Image Fusion (provided as 
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prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Solomon et al. (US 2003/0018251). 

13. Addressing claims 10-11 and 17, Packer, Rose, Hemler, Maurincomme and 
Webler do not disclose an instantaneous distance of a catheter tip from a 
predeterminable picture element of the 3D image data and the distance is represented 
by color coding of the visualization of the catheter. Solomon discloses an instantaneous 
distance of a catheter tip from a predeterminable picture element of the 3D image data 
and the distance is represented by color coding of the visualization of the catheter (see 
[0056-0058]). It would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify Packer's method to have an instantaneous distance of a 
catheter tip from a predeterminable picture element of the 3D image data and the 
distance is represented by color coding of the visualization of the catheter as taught by 
Solomon because the coded representation provide a better visualization for the 
operator and the operator can easily determine the distance by looking at the color 
code. 

14. Addressing claims 15-16, Packer, Rose, Hemler, Maurincomme and Webler do 
not disclose a calculation module to calculate an instantaneous distance of a catheter 
tip from a predeterminable picture element of the 3D image data. Packer also does not 
disclose the visualization module for the coded representation of the calculated distance 
in real time. Solomon discloses a system that included a calculation module to calculate 
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an instantaneous distance of a catheter tip from a predeterminable picture element of 
the 3D image data, the visualization module and a method step for the coded 
representation of the calculated distance in real time for better visualization for the 
operator (see [0056-0058]). The calculated module is inside the system. The system 
has to have a calculation module in order to make the calculation. It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify Packer's 
system with a calculation module to calculate an instantaneous distance of a catheter 
tip from a predeterminable picture element of the 3D image data, the visualization 
module being constructed for the coded representation of the calculated distance in real 
time taught by Solomon because the coded representation provide a better visualization 
for the operator and the operator can easily determine the distance by looking at the 
color code. 

15. Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over Packer et 
al. (US 6,556,695), in view of Rose (US 2002/0176608) further in view of Hemler et al. 
(A System for Multimodality Image Fusion (provided as prior art in the IDS)), 
Maurincomme et al. (US 2001/0036303), Webler (US 2007/0055142) and further in view 
of Massaro et al. (2002/0087329). 

16. Addressing claim 6, Packer, Rose, Hemler, Maurincomme and Webler do not 
disclose visualized image data on a polygonal grid. Massaro discloses visualize image 
on a polygonal grid for easily matching location and distance (see claim 58). It would 
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have been obvious to one of ordinary skill in the art at the time of the invention to modify 
Packer's method to visualized image data on a polygonal grid taught by Massaro 
because with a polygonal grid the viewer can easily match location and determine 
distance. 

17. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over Packer et 
al. (US 6,556,695), in view of Rose (US 2002/01 76608), further in view of Hemler et al. 
(A System for Multimodality Image Fusion (provided as prior art in the IDS)), 
Maurincomme et al. (US 2001/0036303), Webler (US 2007/0055142), Shoji et al. (US 
6,572,476) and Chiu et al. (US 2004/0233217). 

18. Addressing claim 7, Packer, Rose, Hemler, Maurincomme and Webler do not 
disclose adjustable transparency and adjustable blending factor. Shoji discloses 
adjustable transparency to make the image more or less visible (see col. 9, lines 1 -22). 
Chiu discloses adjustable blending factor to control the visibility of the output image (see 
[0007-0008]). It would have been obvious to one of ordinary skill in the art to modify 
Packer's method with adjustable transparency and adjustable blending factor taught by 
Shoji and Chiu because adjustable transparency and adjustable blending factor allow 
the operator to adjust the level of visibility of the images. 



Response to Arguments 



Application/Control Number: 10/569,958 Page 14 

Art Unit: 3777 

Applicant's arguments with respect to claims 1 -26 have been considered but are 
moot in view of the new ground(s) of rejection. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HIEN NGUYEN whose telephone number is (571)270- 
7031 . The examiner can normally be reached on 7:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Robert Chen can be reached on (571) 272-3672. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-91 99 (IN USA OR CANADA) or 571 -272-1 000. 

/H. N./ 

Examiner, Art Unit 3777 



Application/Control Number: 10/569,958 Page 15 

Art Unit: 3777 

/Tse Chen/ 

Supervisory Patent Examiner, Art Unit 3777 



